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Abstract 

Background: Despite international guidelines describing psychotherapy as first choice for people with personality 
disorders (PDs), well-designed research on the effectiveness and cost-effectiveness of psychotherapy for PD is 
scarce. Schema therapy (ST) is a specific form of psychological treatment that proved to be effective for borderline 
PD. Randomized controlled studies on the effectiveness of ST for other PDs are lacking. Another not yet tested 
new specialized treatment is Clarification Oriented Psychotherapy (COP). The aim of this project is to perform an 
effectiveness study as well as an economic evaluation study (cost effectiveness as well as cost-utility) comparing ST 
versus COP versus treatment as usual (TAU). In this study, we focus on avoidant, dependent, obsessive-compulsive, 
paranoid, histrionic and narcissistic PD. 

Methods/Design: In a multicentered randomized controlled trial, ST, and COP as an extra experimental condition, 
are compared to TAU. Minimal 300 patients are recruited in 12 mental health institutes throughout the 
Netherlands, and receive an extensive screening prior to enrolment in the study. When eligible, they are randomly 
assigned to one of the intervention groups. An economic evaluation and a qualitative research study on patient 
and therapist perspectives on ST are embedded in this trial. Outcome assessments (both for clinical effectiveness 
and economic evaluation) take place at 6,12,18,24 and 36 months after start of treatment. Primary outcome is 
recovery from PD; secondary measures include general psychopathological complaints, social functioning and 
quality of life. Data for the cost-effectiveness and cost-utility analyses are collected by using a retrospective cost 
interview. Information on patient and therapist perspectives is gathered using in-depth interviews and focus 
groups, and focuses on possible helpful and impeding aspects of ST. 

Discussion: This trial is the first to compare ST and COP head-to-head with TAU for people with a cluster C, 
paranoid, histrionic and/or narcissistic PD. By combining clinical effectiveness data with an economic evaluation 
and with direct information from primary stakeholders, this trial offers a complete and thorough view on ST as a 
contribution to the improvement of treatment for this PD patient group. 

Trial registration: Netherlands Trial Register (NTR): NTR566 



Background 

Personality disorders (PDs) are characterized by an 
enduring, pervasive and pathological pattern of thoughts, 
feeling and behavior expressed in a dysfunctional and 
inappropriate manner, which is deviant from societal 
norms. In the DSM-IV, personality disorders are grouped 
into 3 clusters: the 'odd, eccentric' cluster A (paranoid, 
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schizotypal and schizoid PD), the 'dramatic' cluster B 
(borderline, antisocial, histrionic and narcissistic PD), 
and the 'anxious' cluster C (avoidant, dependent and 
obsessive-compulsive PD) [1]. Despite the frequent appli- 
cation of prolonged psychotherapy for people with per- 
sonality disorders, controlled research into the clinical 
and cost-effectiveness of psychotherapy is scarce [2]. This 
is remarkable, given the substantial burden on patients 
and society. Moreover, PDs are highly prevalent, as seen 
in numbers ranging from 3 to 15% in community popula- 
tion up to as high as 80-90% in secondary health care 
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settings [3-6]. PD-patients show chronic dysfunctions on 
social and interpersonal level [7-10] and experience sub- 
stantial impairment in work and basic self-care [11], lead- 
ing to an enormous negative impact on the patient's life 
and the life of his/her close relatives. Furthermore, PDs 
and personality-related factors play a key role in the 
development and progress of other mental disorders, as 
demonstrated in numerous cross-sectional and prospec- 
tive studies [12-16]. 

Apart from patients, also society bears the costs of 
chronic personality pathology. Factors attributing to 
these notable costs are increased health care utilization, 
productivity losses, and unstable employment through- 
out the lifespan [17,18]. A recent study showed that the 
costs of untreated PDs in the Netherlands are substan- 
tially higher than those of other psychopathology like 
depression or generalized anxiety disorder [19]. 

The evidence on treatment effectiveness for PDs that 
exists so far is mostly restricted to borderline PD (BPD) 
[20]. Several reviews report large effect sizes of specia- 
lized psychological treatments for all PDs in general [21] 
and specifically for cluster-C [22]. However, it should be 
noted that most studies into treatment of non-BPD PDs 
are of questionable methodological quality and show 
conflicting results. A few RCTs focused on cluster-C 
PDs. Emmelkamp et al. [23] showed greater improve- 
ment in cognitive over psychodynamic psychotherapy for 
Avoidant PD, while Svartberg, Stiles & Seltzer [24] found 
these treatment forms to be equally effective for Cluster 
C PDs. Another study [25] comparing manualized versus 
non-manualized dynamic psychotherapy showed equal 
decreases in the severity of PD symptoms, but both treat- 
ment conditions failed to reduce psychiatric symptoms to 
a 'healthy' level at post-test. Inconsistent findings also 
appear when focusing on different treatment modalities 
instead of different theoretical frameworks for cluster C. 
Recent evidence suggests that outpatient psychotherapy 
is equally effective as day treatment [26], while a natura- 
listic study [27] showed only modest improvement for 
outpatient therapy following day treatment in which con- 
siderable progress was made. Bartak et al. [28] compared 
different treatment modalities for cluster C in a multi- 
center non-experimental study in the Netherlands, and 
results favored short-term inpatient treatment over other 
treatment modalities. On top of these contradictory find- 
ings, studies on treatment effectiveness involving cluster 
C are often difficult to interpret because this group of 
PDs is mostly not the main research focus but partly 
allowed as comorbid psychopathology (e.g. [29,30]). 
Methodologically sound scientific investigation of treat- 
ment effectiveness for paranoid, histrionic and narcissis- 
tic PD hardly exists [31-33]. 

In a budget-constrained society, other important 
aspects in the evaluation of a new treatment form are 



costs and benefits of treatment. Unfortunately, for this 
patient group the same paucity of controlled cost-effec- 
tiveness studies is seen as with clinical effectiveness. The 
few studies that suggest cost-effectiveness often are not 
based on formal and well-prepared cost analyses [34]. 
An exception herein is an economic evaluation study 
alongside the Dutch non-experimental study mentioned 
before, in which cost-effectiveness of different treatment 
modalities for both cluster B and C PDs is assessed 
[35,36]. Results show that optimal treatment choice 
depends on what threshold is considered acceptable. 
Although this research group executed pioneering 
research in economic evaluations for non-BPD patient 
groups, findings are difficult to interpret because of dif- 
ferent focus (modalities instead of theoretical frame- 
work) and non-randomization of patients. 

Schema therapy (ST) gained a lot of attention the past 
decade as a promising treatment for PDs. Clinical effec- 
tiveness is shown for borderline PD both in an extensive 
RCT (comparing ST head-to-head with Transference 
Focused Psychotherapy (TFP) [37]) and in a Dutch 
implementation study [38]. Also in group format ST 
showed positive results for borderline PD [39]. The first 
RCT mentioned demonstrated ST to be less costly and 
more effective than TFP, so preferable in terms of cost- 
effectiveness [40]. 

Because the aforementioned shortcomings, the need for 
properly designed studies of psychological interventions 
for non-Borderline PDs is pressing [33,41]. This is espe- 
cially important as psychological treatment is considered 
to be the treatment of choice for these disorders [34]. 
Despite some evidence for the effectiveness of ST techni- 
ques for PDs other than borderline [42], properly designed 
effectiveness and economic evaluation studies comparing 
ST with other psychological treatments for non-borderline 
PDs are lacking. The main objective of this study is to 
evaluate the clinical and cost effectiveness of ST for a 
group of 6 PDs: avoidant, dependent, obsessive-compul- 
sive, paranoid, histrionic and narcissistic PDs. Other PDs 
(borderline, antisocial, schizotypal and schizoid) are 
excluded as they are deemed to require highly specialized 
treatment protocols and higher dosage of treatment. In 
this study a treatment protocol of 50 ST-sessions is com- 
pared to treatment as usual (TAU). To assess to what 
degree a possible positive effect of ST is the result of the 
effects of a new specialized and promising treatment, we 
add the comparison of TAU with another specialized 
treatment, clarification oriented psychotherapy (COP), a 
form of client centered therapy developed for PDs [43] , to 
the design. Apart from the clinical effect study and eco- 
nomic analysis, in a qualitative research part patients and 
therapists are asked to provide insight in helpful and not 
helpful aspects of the ST protocol. By collecting input 
from direct users, valuable information is obtained to 
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improve the ST protocol and tailor it to the needs of pri- 
mary stakeholders. 
The following research questions are defined: 

Effectiveness study 

How do ST and COP compare to TAU, in terms of 
recovery from PD-diagnosis, reduction of psycho- 
pathological symptoms and improvement of quality 
of life? 

Are these new treatments better in retaining patients 
in therapy than TAU? 
Economic evaluation 

From a societal perspective, are ST and COP prefer- 
able to TAU in terms of costs, effects and utilities? 
Patient and therapist perspectives 
What do patients and therapists believe to be helpful 
and not helpful factors in the ST protocol? 
Based on the superiority of ST found in previous 
research, we hypothesize that (a) ST shows greater 
clinical improvement than TAU, and (b) seen from a 
societal perspective, ST is more cost effective in 
terms of costs and utilities. Similarly, we test 
whether another specialized treatment of PD, COP, 
is superior to TAU in these respects. 

Methods 

This trial includes a clinical effectiveness study, an eco- 
nomic evaluation and a qualitative research part regard- 
ing patient and therapist perspectives on ST. 

Clinical effect study 
Design 

The study is a multicentered randomized controlled trial 
(RCT), in which patients are assigned to either ST or 
TAU, while in 3 centers COP is added as a third treat- 
ment condition. In Figure 1, information on patient flow, 
screening procedures and intermittent assessments is 
graphically shown. The research protocol is approved by 
the Medical Ethical Committee of Maastricht University/ 
University Hospital Maastricht and by local committees 
in participating centers. 
Recruitment 

Patients are recruited in 12 mental health care institutes 
throughout the Netherlands (Geestgronden Noord-Hol- 
land, GGZ Oost-Brabant, GGZ Nijmegen, Mediant 
Enschede, Mondriaan Zorggroep Heerlen, Reinier van 
Arkelgroep Den Bosch, Riagg Maastricht, Riagg Rijnmond, 
Riagg Zuid Roermond, Rivierduinen Leiden, Symfora 
Hilversum, and UMC Radboud Nijmegen). They are 
referred to the study either during intake (i.e. at first con- 
tact with mental health care institute), after having 
received previous care that failed to reduce their PD pro- 
blems, or by clinicians treating these patients for chronic 
problems. After patients receive both written and oral 



information and signed informed consent, in- and exclu- 
sion criteria are checked. 
Participants 

Patients are eligible if they have one or more diagnoses 
of avoidant, dependent, obsessive-compulsive, paranoid, 
histrionic and/or narcissistic PD. This PD has to be the 
principal diagnosis, according to both patient and clini- 
cal staff, and patients should request help for PD-related 
problems. Further, inclusion criteria are age 18-65 and 
not having problems with Dutch language (talking, 
understanding, reading and writing). In- and exclusion 
criteria are described in Figure 1. 

At baseline clinical diagnoses are assessed with the 
Dutch version of the Structured Clinical Interviews 
(SCID) for DSM-IV Axis-I and Axis-II disorders ([44-47] 
and executed by extensively trained clinicians at local 
sites). For clients having more than 1 PD diagnosis, main 
diagnosis is determined by the interviewer or -if missing- 
by 2 raters (LB & AA) after clinical judgment and taking 
into account self-reported reason for seeking help. 
Sample size 

Power calculations for ST and TAU are based on the 
results from the BPD trial comparing ST and Transfer- 
ence Focused Psychotherapy (TFP) [37]. The study is 
powered to detect a difference between ST and TAU in 
proportion recovered patients of 46 vs. 24% (OR = 2.70). 
With alpha = .05 (2-tailed), n = 100 per condition yields 
a power of 90%. To account for possible dropouts (ca. 
18% expected based on [48]), 125 patients are needed per 
condition. With the planned sample sizes (ST = 125; 
TAU = 125; COP = 50) power is 78% (70% after dropout) 
to detect a similar difference between COP and TAU. 
Randomization and procedure 

Following inclusion in this trial, patients complete an 
extensive baseline assessment prior to randomization. 
An independent statistician generated a computerized 
randomization list using Adaptive Biased Urn Randomi- 
zation for small strata [49], which keeps randomization 
unpredictable up to and including the last patient on 
each site, while keeping the group sizes at each site in 
good balance. A study-independent central research 
assistant checks in/exclusion criteria, and reads the next 
available treatment condition per center from this ran- 
domization list, and passes it on to local staff by e-mail. 
Once allocated, further matching between patient and 
therapist is allowed and performed by local teams (ST & 
COP) and regular intake staff (TAU). 

After start of treatment, assessments occur every 6 
months during the first 2 years, followed by a follow up 
assessment 3 years after start of therapy. All assessments 
are executed by independent research assistants at local 
sites, except for SCID-interviews which are performed by 
trained clinicians at local sites during inclusion period and 
by trained independent interviewers at follow-up. In 
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Inclusion 

• 1 or more diagnoses of avoidant, dependent, obsessive- 
compulsive, paranoid, histrionic and/or narcissistic PD 

• PD is principal diagnosis, for which patient seeks help 

• availability for study (e.g. no plans to move to other areas) 

• age 18 to 65 

• not having problems with Dutch language 
Exclusion 

• presence of borderline, antisocial, schizoid or schizotypal PD 

subthreshold) 

• lifetime prevalence of psychosis or bipolar disorder 

- immediate suicide risk 

- substance abuse with immediate need for clinical detoxification 

- IQ below 80 



Recruitment population 



1 



Screening eligible subjects 



Informed consent and baseline assessment 



Central independent randomization 



ST (planned N = 125) 



TAU (planned N = 125) 



COP (planned N = 50; only at 3 sites) 



1 



Treatment 

• 40 weekly sessions in year 1 

• 10 booster sessions in year 2 

• therapists have weekly local peer 
supervision and yearly national 
supervision 

l 

Assessments 

• 6 months 

• 12 months 

• 18 months 

• 24 months 

• 36 months 



Treatment 

• care as usual without protocol restrictions 



1 



Assessments 

• 6 months 

• 12 months 

• 18 months 

• 24 months 

• 36 months 



Treatment 

• weekly sessions 

• open ended therapy 

• therapists have weekly local peer 
supervision and yearly national 
supervision 

I 

Assessments 

• 6 months 

• 12 months 

• 18 months 

• 24 months 

• 36 months 



Figure 1 : Flow chart study design. ST = schema therapy, TAU = treatment as usual, COP = clarification oriented psychotherapy 
Figure 1 Flow chart study design. ST = schema therapy, TAU = treatment as usual, COP = clarification oriented psychotherapy. 



general, assessments comprise self-report questionnaires 
(administered on PC), a cost-interview and a computer 
task. When study dropout is imminent due to unwilling- 
ness to come to the center for assessments, questionnaires 
could be filled out at home. In these cases, cost interviews 
are administered by telephone. Given the nature of our 
study, blinding of participants and research assistants is 
not possible. However, the primary outcome is assessed by 
independent central interviewers, blind for condition. To 
optimize similarity in assessments, research assistants 
receive a one-day training regarding the study protocol 
given by members of the central research committee of 
Maastricht University, discuss process in regular telepho- 
nic meetings and use an extensive standardized study 
protocol. 
Treatments 

All sites offer ST and TAU. In 3 centers a third treatment 
condition (COP) is added. In this way, a standardized and 
highly specialized outpatient treatment is added as an 



extra control. Because of restricted COP-therapist capa- 
city at most sites, COP is only offered at 3 sites. 

ST and COP are characterized by the following com- 
monalities: therapists receive extensive expert-training at 
study start, yearly national supervision and weekly peer- 
supervision at local sites; both are outpatient treatments, 
(initially) delivered in weekly sessions; additional psycho- 
logical treatment with focus on personality pathology is 
not allowed; and psychopharmacological treatment is 
permitted, but only on clinical indication according to an 
independent psychiatrist. 

Schema therapy (ST) Schema therapy (ST) was originally 
developed for people with severe personality pathology 
and combines experiential, cognitive-behavioral, psychody- 
namic and interpersonal techniques [50]. The concept of 
schema modes is central in current ST [51]. ST aims at 
reducing maladaptive modes and strengthening the 
healthy adult mode. Arntz & Young created a theoretical 
model containing the most prevalent modes for the 6 PDs 
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under study [52,53]. For this study, a 50-session treatment 
protocol is developed with 40 weekly sessions in year 1 
and 10 booster sessions in year 2. The treatment protocol 
is naturalistic in the sense that, apart from the framework 
directing treatment focus throughout sessions, therapists 
do not have a session-to session detailed treatment 
manual. 

At start of treatment, a maximum of 6 sessions is 
spent on introduction, patient history and case concep- 
tualization. During the first half year, focus mainly lies 
on in-session child, parent and coping modes with 
emphasis on processing childhood experiences through 
imagery rescripting and other experiential techniques. In 
the second half year, current life experiences and active 
changing of behavior are targeted. Booster sessions in 
the second year could be spread according to the wishes 
of therapist and patient, and are intended to maintain 
newly acquainted healthy behavior, recognize possible 
pitfalls and prevent relapse. 

Clarification oriented psychotherapy (COP) COP is a 
treatment rooted in client centered therapy (CCT), 
developed by Sachse [43,54]. It was designed to clarify 
and restructure dysfunctional cognitive-affective sche- 
mas focusing strongly on interpersonal behavior and 
problems. COP also offers specific techniques in the 
treatment of PDs. In this model, PDs are conceptualized 
on a dimension ranging from slight characteristics of a 
PD (not diagnosed by DSM-IV), to pathological and 
extreme interaction patterns. Based on unmet social 
needs in childhood or youth, interaction patterns are 
developed which may have been functional at the time, 
but are not anymore. According to Sachse, PD-charac- 
teristics occur at 3 levels: (1) the level of authentic 
needs: appreciation, importance for (to) others, reliabil- 
ity of relationships, solidarity of relationships, autonomy 
and boundaries (2) the level of schemas, which are 
assumptions about the self and others, and (3) the level 
of play, which is highly automated and not transparent, 
manipulative and controlling. Whilst this play behavior 
is intended to get needs fulfilled, this often doesn't 
work. The goal of treatment is to enlarge the authentic 
being of patients, by satisfying authentic needs, gaining 
insight in schemas and reducing play behavior. Thera- 
peutic techniques to achieve this are being complemen- 
tary with authentic needs, uncomplimentary with play 
behavior, confronting with play behavior and clarifying 
and restructuring rigid schemas. Just like the first year 
in the ST protocol, COP is offered weekly to patients. 
Contrary to the ST protocol, COP is open ended with- 
out a strict number of treatment sessions, as this fits 
best with its CCT nature. 

Treatment as usual (TAU) In this treatment condition, 
treatment is whatever care (except ST/COP) a patient 
would receive if the study would not take place. Generally 



TAU is expected to follow the multidisciplinary clinical 
guidelines for PDs in the Netherlands [55]. When allo- 
cated to TAU condition, the regular intake staffs at local 
sites indicate the specific treatment format for that patient. 
Thus, the matching of patient to type of regular treatment 
by the responsible clinicians at the site is part of TAU. In 
this way, TAU is optimized and mimics usual practice. 
Therapists, training, and treatment integrity check 
ST and COP therapists received an extensive 4 day 
expert-training before study start. Due to one center 
withdrawing participation after training but before 
recruiting patients, two extra sites were added to com- 
pensate, and extra therapists (also from the first group of 
centers) were trained in ST in a second training. This 
creates two 'waves' in the study (from now on referred to 
as therapy cohorts). There are potentially important dif- 
ferences between the two ST-trainings. The first cohort 
was trained in a foreign language (English) and consisted 
of 73 therapists, while the second cohort consisted of 20 
therapists who were trained in their native language 
(Dutch). Training in the first cohort consisted mainly of 
lectures and video demonstrations, whereas the second 
training was much more structured with short instruc- 
tions, life demonstration, and compulsory role-plays for 
the participants to train the main therapeutic techniques. 

Therapists are uniquely assigned to one of the treat- 
ment conditions to prevent contamination, with the 
exception of 6 ST and 3 COP therapists who also act as 
a group-therapist in TAU. This exception is allowed as 
these therapists have non-ST/COP co-therapists that 
help them to stick to the non-ST/COP format of these 
group therapies. 

Adherence to treatment protocol and absence of tech- 
niques and elements from contrasting treatments is 
checked. Except for group treatment in TAU (where 
non-study participants do not give consent to record ses- 
sions), all treatment sessions are audio taped. Eventually, 
3 sessions per patient are randomly selected for evalua- 
tion; 1 from the first 5 weeks, 1 from the first half year 
and 1 from the second half year of treatment. An instru- 
ment to measure treatment adherence is developed based 
on the ST Therapy Adherence and Competence Scale for 
BPD [56], the Collaborative Study Psychotherapy Rating 
Scale 6 (CSPRS-6);[57,58], and elaborated consultation 
with ST- and COP-experts. 

Economic evaluation study 

The economic evaluation is performed from a societal 
perspective, and involves a combination of a cost-effec- 
tiveness analysis (CEA) and a cost-utility analysis (CUA). 
In a CEA effects are presented in clinical outcomes (in 
our study recovery of diagnosis). The primary outcome 
measures for the cost-utility analysis are QALYs, based 
on the EuroQol utility scores [59,60]. Comparing ST and 
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COP separately with TAU yields four Incremental Cost 
Effectiveness Ratios (ICERs) that express the incremental 
costs per recovered patient and per QALY gained. The 
net monetary benefit (NMB) is feasible to compare three 
treatments in one analysis. The NMB is calculated by 
multiplying the increase in effectiveness by the amount 
decision-makers are willing to pay for one extra unit of 
effect, minus the increase in costs. In the base-case ana- 
lyses, a monetary threshold of € 20,000 is used [40]. 

For the identification of costs, a division is made into 
healthcare costs and productivity losses. Because it is 
very hard to make a clear distinction between PD- 
related and non-PD-related costs, all costs are taken 
into account. Costs are divided into (1) main interven- 
tion costs in participating health care center (i.e. treat- 
ment patients were randomly assigned to) (2) other 
mental health care received, (3) health care costs, con- 
taining medication (divided in prescribed and over the 
counter medication), general practitioner, emergency 
care, outpatient consults in general hospital, and admis- 
sions to general hospital, and (4) productivity costs 
(further divided in costs due to PDs and costs due to 
other complaints). 

Patient and therapist perspectives 

We aim to identify specific helpful and not helpful 
aspects of the ST protocol used in this study. This infor- 
mation is derived by using qualitative research methods 
with primary stakeholders (patients and therapists). A 
selection of ST patients and therapists is asked to parti- 
cipate in this qualitative study, as many as necessary 
until saturation appears (when no more information is 
added and replication occurs). Patients receive semi 
structured in-depth interviews in the early phases of 
treatment (time point 1) and after completion of treat- 
ment (time point 2). At time point 2, also patients who 
dropped out of treatment are interviewed. Therapists 
share their experiences in a focus group (structured 
group session in which thoughts and views about certain 
predefined ST topics are exchanged, led by a chairper- 
son) at equal time points. Some main topics are: helpful 
and harmful aspects of ST, the use of specific ST techni- 
ques, therapeutic relationship, supervision and training 
of therapists. 

Patient interviews and therapist focus groups are 
recorded and fully transcribed. All participants receive a 
verbatim transcript and are asked to verify whether their 
opinion is expressed correctly (member check). 
Instruments 

Instruments are used in the screening process, the clini- 
cal effect study and the economic evaluation study. In 
Table 1 an overview of all instruments per time point is 
shown. 



Primary outcome and PD-diagnosis 

Structured clinical interview for personality disorders 
(SCID-II) 

Primary outcome is presence versus absence of PDs, 
which is assessed with SCID-II-interviews at follow-up 3 
years after start of treatment. Interviews are administered 
by telephone after the follow up assessment at local sites 
and executed by a group of independent raters blinded 
for condition. Raters are trained in SCID interviews, and 
inter rater reliability is assessed. Only those PD-modules 
and criteria are assessed on which patients scored at 
baseline and further all specific DSM-IV criteria on 
which patient scored 4 or more on the 1-7 scale of the 
ADP-IV at follow up (when 3 or more criteria per PD 
had a >4 score, the complete PD had to be assessed). 
Each relevant PD-criterion has to be scored as absent 
(score 1), questionable (score 2), or present (score 3) for 
both the 6 months prior to FU, and the half year before 
that. The sum of 3-scores points out whether sufficient 
criteria are met for a specific PD-diagnosis. Previous stu- 
dies found adequate to good inter-rater reliability for 
SCID II interviews [61] [62] [63]. Recovery from diagnosis 
as measured with SCID II is the primary outcome mea- 
sure in this study. When patients do not exceed the mini- 
mal number of criteria needed to obtain a diagnosis on 
any of the 6 PDs under study, they are considered to be 
recovered. Because of the lenience of this criterion, we 
assess sensitivity by reanalyzing presence vs. absence of 
subthreshold diagnoses (defined by meeting one PD-cri- 
terion less than needed for a full diagnosis). 

Secondary outcomes 

Assessment of DSM-IV personality disorders ques- 
tionnaire (ADP-IV) 

At every intermediate and follow up assessment, PD- 
pathology and associated distress are assessed with the 
ADP-IV [64]. With this self- report questionnaire, DSM- 
IV PD criteria are assessed. Patients have to indicate on a 
7-point Likert scale to what degree PD criteria hold for 
them, ranging from 1 ('not at all') to 7 ('completely'), and 
whether they experience distress from it (on a range 
from 1-not at all to 3 -definitely). Item construction of the 
ADP-IV allows for both dimensional and categorical 
diagnostic evaluation [65]. Adequate internal consistency, 
validity and reliability were shown consistently in pre- 
vious studies [65-67]. 

Structured clinical interview for axis I disorders 
(SCID I) 

SCID I is used both as screening and outcome instru- 
ment. During screening, SCID I [44,46] is used to check 
for Axis I diagnoses that might lead to exclusion (psycho- 
sis, bipolar disorder, substance abuse). At follow up, 
Axis-I diagnoses of mood and anxiety disorders (as the 
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Table 1 Overview of instruments per time point 

Screening Baseline 6 months 12 months 18 months 24 months 36 months 

SCID II 
SCO I 

ADP-IV ...... 

GAF ...... 

SOFAS ...... 

SCL-90 ...... 

WSAS ...... 

MSGO ...... 

Whoqol-short version ... 
Euroqol-5D ... 
Cost interview ... 

SCID I = Structured Clinical Interview for Axis-I Disorders, SCID-II = Structured Clinical Interview for Axis-ll Disorders, ADP-IV = Assessment of DSM-IV Personality 
Disorders Questionnaire, GAF = Global Assessment of Functioning, SOFAS = Social and Occupational Functioning Scale, SCL-90 = Symptom Check List, WSAS = 
Work and Social Adjustment Scale, MSGO = Miskimins Self Goal Other, Whoqol-short version = World Health Organization Quality of Life Questionnaire - short 
version 



most prevalent at baseline) are assessed by the same 
blind interviewers registering SCID II. SCID I proved to 
have acceptable psychometric properties [61]. 

Global assessment of functioning scale (GAF) and 
social and occupational functioning scale (SOFAS) 

These 100-point scales are derived from DSM Axis V, 
to assess global functioning & symptom severity (GAF) 
and social functioning (SOFAS). Both scales are admi- 
nistered by the research assistant at each measurement 
after a semi-structured interview to elicit relevant infor- 
mation. Lower scores indicate poorer functioning and 
greater symptom severity. These scales have shown to 
be a valid and reliable rating scale of global psycho- 
pathology [68,69]. 

Symptom check list (SCL-90) 

General psychopathological symptoms are assessed 
with the SCL-90 [70]. This self-report inventory con- 
tains 90 items that have to be scored on a 5-point Likert 
scale of distress, ranging from 'not at all' to 'extremely'. 
The total score can be used as a measure of global 
symptom severity. The SCL-90 has good psychometric 
properties [71]. 

Work and social adjustment scale (WSAS) 

The WSAS is a simple 5-item list used to assess gen- 
eral impairment on several life domains like work, 
household, social and private leisure, family and rela- 
tionships [72]. Each item has to be scored on a range 
from 0 to 8. Higher scores denote more disability. This 
instrument proved to be reliable, valid and change-sensi- 
tive in various patient populations [73]. 

Miskimins self goal other (MSGO) 

The MSGO is a measure to assess discrepancy 
between actual and ideal self- perception [74]. 30 person- 
ality trait dimensions have to be scored on a 100 mm 
visual analogue scale, for current and ideal self-percep- 
tion respectively. Discrepancy scores are derived by 



calculating the mean difference across items. The 
MSGO has shown adequate psychometric properties in 
previous studies [42,75]. 

World health organisation quality of life question- 
naire (Whoqol-short) 

Quality of life is assessed with a modified version of 
the World Health Organisation Quality of Life Ques- 
tionnaire. Patients have to self-report to what extent 
they experience quality of life on several domains (phy- 
sical, psychological, social relationships, environment, 
positive feelings, negative feelings, self-esteem) [76,77]. 
Psychometric studies revealed the WHOQOL to be a 
valid and reliable measure. 

Euroqol-5D 

The EuroQol is a standardized non-disease specific 
instrument for describing and valuing health-related 
quality of life. Next to the assessment of quality of life 
on five health-state dimensions (mobility, self-care, usual 
activity, pain/discomfort and anxiety/depression), the 
EuroQol thermometer ranges someone's current health 
status between 0 and 100 [59]. For the cost-utility analy- 
sis, the profiles resulting from the five health-state 
dimensions can be converted into utilities based on the 
social tariffs of the EuroQol, the so-called EQ-5D UK 
value set [78]. Utilities refer to the preference for any 
particular set of health outcomes and are generally indi- 
cated by a number between 0 and 1. Utilities at different 
time points are used to compute QALYs. A QALY com- 
bines preferences for both length of survival and its 
quality into one single measure. 

Resource use 

For the resources, a distinction is made between inter- 
vention costs and other resource use. The number of 
sessions and specific content of interventions are gath- 
ered by local research assistants, while costs of all other 
resources are measured by means of a structured cost 
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interview [79] at every assessment. In this interview, 
patients are asked to specify work status and absentee- 
ism, and they report the use of medication, GP visits 
and contacts with different services. The cost interview 
is retrospective in nature. For most questions a 3-month 
recall period is used, except for costly admissions to 
general or psychiatric hospitals and crisis services, in 
which a 6 or 12 month recall period is used (for inter- 
mittent and follow up assessments respectively). 

Analyses 

All analyses are planned to be carried out with SPSS 
19.0 and MLWin 1.10, while bootstrap simulations are 
done using Excel. 
Clinical analyses 

Data analyses are based on intention to treat analyses 
(including all patients regardless of whether they drop 
out from treatment or not), using all available data. 
Intermittent missing data on item level are imputed by 
mean values from previous and subsequent time points. 

Primary outcome (recovery from PD diagnosis) and 
dichotomous secondary outcome parameters (absence of 
comorbid depression or anxiety disorder), are analyzed 
with multilevel logistic regression. Continuous secondary 
outcome parameters are analyzed with multilevel mixed 
models. In these multilevel models center is treated as a 
random factor (i.e., random intercepts and slopes (if 
applicable)). If changes over time are mainly linear, lin- 
ear trend in time is inspected; otherwise the time vari- 
able is transformed to obtain a linear relationship. 
When outcome parameters are not distributed normally, 
appropriate transformations are used. 

Predictors of outcome are incorporated in the ana- 
lyses. To control for baseline severity a composite mea- 
sure is constructed out of standardized baseline values 
of: # axis-I disorders, # axis-II disorders, ADP-4 trait 
sum score, ADP-4 distress sum score, SCL-90, GAF, 
SOFAS, disability status (biographical variable). Being 
new vs. 'chronic' patient is not associated with these 
variables, neither with outcome, thus left out of consid- 
eration. The severity-index is used as covariate in out- 
come analyses. Since the difference between a more 
passive and a more active, experiential-learning oriented 
training is potentially very important for implementation 
and for effectiveness of treatment, we include this vari- 
able in the analyses to test for moderation, and to con- 
trol for possible effects. For 2 sites, all ST therapists 
were trained in the second cohort; therefore all TAU- 
patients of these sites are their patients' controls. For 
other sites, a minority of ST-therapists was trained in 
the second cohort, and control TAU patients are 
selected per site by matching TAU-patients to the 2nd 
cohort ST-therapists' patients on the basis of 1st diagno- 
sis, gender and age. 



Given the strong positive effect of ST on treatment 
retention found in earlier studies [37-39], dropout is 
analyzed with both multilevel logistic regression and 
survival analysis (to account for development over time). 

To assess treatment integrity, a random selection of 
audiotapes of treatment sessions is rated by trained 
independent judges, blind for condition. A subset of 
recordings is rerated to estimate inter rater reliability, 
expressed with the intra class correlation coefficient 
(ICC). 

Economic evaluation 

The economic analysis is also performed according to 
the intention-to-treat principle. As mentioned before, 
both a cost-effectiveness analysis CEA (expressing 
effects as recovery of diagnosis) and cost-utility analysis 
CUA (effects expressed as QALYs) are done. 

For the valuation of cost prices, standard Dutch unit 
prices are used [80] or-when unavailable- average tariffs. 
Prescribed medication costs are based on the Dutch 
Pharmacotherapeutic Compass [81]. Productivity costs 
are calculated according to the human capital method 
(total productivity costs are the product of total hours 
lost with hourly wage), as this method is preferable in 
patient groups with apparent disease-related work dis- 
ability [82]. 

Costs are calculated by multiplying volumes with price 
per cost item. All prices are expressed in Euros for the 
year 2007 (since the majority of treatments started in 
this year). If necessary, costs are indexed to the year 
2007 by means of the consumer price indexes of the 
Dutch Central Bureau of Statistics (CBS). Since the time 
horizon of the study is 3 years, a discount of 4% per 
year is applied. 

Differences between experimental and control groups 
in quality of life are analyzed with ANOVA or non- 
parametric alternatives at the p < .05 significance level. 
Because of the usually non-normal distribution of costs, 
bootstrapping is used to calculate 95% confidence inter- 
vals around costs. 

For base-case analyses, primary outcome parameters 
are proportion of recovered patients (CEA), and total 
QALY gained during 3 years (CUA). 

Uncertainty around costs and effects is dealt with by 
performing several sensitivity analyses following base-case 
analyses. Some sensitivity analyses are: analyzing only data 
from study completers (patients who have complete data 
sets at every intermittent assessment as well as follow up), 
correcting for baseline costs and utilities, using Dutch [83] 
instead of UK value set for QALYs. 

Bootstrap simulations are used to estimate sample 
uncertainty around the cost-effectiveness ratios and are 
plotted in cost effectiveness planes, in which the posi- 
tion of the bootstrapped cost-effectiveness pairs gives an 
indication for possible superiority of one treatment over 



Bamelis et al. BMC Public Health 2012, 12:75 
http://www.biomedcentral.com/1471-2458/12/75 



Page 9 of 12 



another. In a cost effectiveness acceptability curve 
(CEAC), the probability of ST being superior across a 
range of willingness to pay thresholds is plotted. Since 
the maximum amount of money that society wants to 
pay is unknown, the monetary threshold per QALY will 
be varied between € 0 and € 80,000 [84]. 
Patient and therapists perspectives 

Content analyses are executed on the verbatim tran- 
scripts produced by interviews and focus groups. Recur- 
ring themes and topics are labeled and clustered. 

Discussion 

Personality disorders (PDs) are complex mental health 
problems associated with low levels of quality of life, 
high health care and general society costs, and poor 
prognosis. Psychological treatment is considered to be 
the treatment of choice, but research into the clinical 
and cost effectiveness is sparse and strongly focused on 
borderline PD. The current study aims to study the 
effectiveness of schema therapy (ST) compared to treat- 
ment as usual (TAU) for 6 PDs not so often studied: 
cluster-C (i.e. avoidant, dependent, obsessive-compul- 
sive), paranoid, histrionic and narcissistic PD. As an 
additional control another specialized treatment, clarifi- 
cation oriented psychotherapy (COP), is added as a 
third condition in 3 of the 12 participating centers. 

Methodological considerations 

For our study, a large group of patients and cooperation 
with many different mental health institutes is necessary. 
The large number of patients and centers included 
makes generalizability to population level credible. Fol- 
lowing a group of PD patients for a 3 year period in an 
RCT design is unique in the field. Recommendations for 
psychotherapy research for personality disorders [48] are 
taken into account, such as: (a) long duration of treat- 
ment and follow up measurement, giving the opportu- 
nity to study core characterological change rather than 
symptomatic change, (b) use of psychometrically sound 
and well-known outcome measures, and (c) naturalistic 
ST and COP protocols, resembling real clinical practice 
better than tight and detailed manuals. 

Several limitations and possible pitfalls should be 
noted. First, due to time restrictions on the inclusion 
period, the diagnostic profile of patients is mainly deter- 
mined by the natural flow of patients at local sites. A 
possibly uneven distribution between the 6 PDs under 
study is a consequence of that, which might limit the 
possibilities to draw conclusions on PDs with small 
numbers. Second, comparing an experimental treatment 
condition with treatment as usual sets boundaries to the 
possibility to control for various potentially influencing 
factors (e.g. uneven duration of treatment, frequency of 



sessions, etc.). We try to overcome this by adding a sec- 
ond experimental condition (COP). The choice for TAU 
has merits and demerits. For relatively new treatments 
such as ST a comparison to treatment as usual is a valu- 
able first step: one would at least require that a new 
treatment excels existing practice. TAU includes in our 
study potentially many different treatments, which 
reduces the kind of control experimental psychologists 
would like to see (e.g., of factors like attention, fre- 
quency, expectations, etc.). On the other hand, the 
external validity of the control condition is increased, 
and TAU is optimized by having clinicians making deci- 
sions on what type of regular treatment to offer (e.g., 
see [85] for evidence that intakers can predict effective- 
ness of psychodynamic therapy). Moreover, for cost- 
effectiveness the comparison of a new treatment to 
usual practice is the gold standard [86]. 

Another important problem potentially affecting the 
quality of the study is created by the organizational 
scale of a trial in which so many parties (sites, patients, 
therapists, coordinators, and research assistants) are 
involved. The study's scale and the limited financial 
resources preclude the possibilities for continuous and 
close monitoring and steering. During the trial, 
researchers and centers need the capacity and flexibility 
to overcome numerous problems, e.g. insufficient inclu- 
sion, loss of participating centers/research assistants/ 
therapists and the enrolment of new ones, inadequate 
execution of study protocol, etc. The large scale of the 
study, at least for psychotherapy research, reduces possi- 
bilities to intensively supervise and control treatment 
delivery. In that sense, the present study is a true effec- 
tiveness study, differing from highly controlled efficacy 
studies. 

As to the assessments, we choose for independent and 
blinded interviewers for assessing the primary outcome. 
Whilst this is a strong point, financial and logistic lim- 
itations preclude that secondary interview outcomes and 
the cost-interview are taken by blinded research assis- 
tants. Lastly, the primary outcome is defined by absence 
of PD at 3-yr follow-up, operationalized by not meeting 
criteria for a PD on the SCID-II. This is a bit lenient 
criterion, and therefore we assess sensitivity of results by 
a reanalysis with a stricter criterion, that is the absence 
of full and subthreshold PDs. 

Conclusion 

Schema therapy is gaining interest worldwide as a treat- 
ment for personality disorders. However, its effective- 
ness for most personality disorders is so far unknown. 
This study gives a unique opportunity to fill this gap of 
knowledge by combining clinical and cost effectiveness 
analyses within a large group of PD patients. 
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